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Abstract 

In this paper, we consider a decentralized wireless communication network with a fixed number u of frequency 
sub-bands to be shared among TV transmitter-receiver pairs. It is assumed that the number of active users is a 
random variable with a given probability mass function. Moreover, users are unaware of each other's codebooks 
^ and hence, no multiuser detection is possible. We propose a randomized Frequency Hopping (FH) scheme in which 

each transmitter randomly hops over a subset of u sub-bands from transmission to transmission. Assuming all users 

in 

l/-) transmit Gaussian signals, the distribution of the noise plus interference is mixed Gaussian, which makes calculation 

of the mutual information between the transmitted and received signals of each user intractable. We derive lower and 
upper bounds on the mutual information of each user and demonstrate that, for large Signal-to-Noise Ratio (SNR) 
values, the two bounds coincide. This observation enables us to compute the sum multiplexing gain of the system 

•l-H 

^ and obtain the optimum hopping strategy for maximizing this quantity. We compare the performance of the FH 

H 

system with that of the Frequency Division (FD) system in terms of the following performance measures: average 
sum multiplexing gain (j/ 1 -*), average minimum multiplexing gain per user (r/ 2 -*), minimum nonzero multiplexing 
gain per user (t/ 3 )) and service capability (rj^). We show that (depending on the probability mass function of 
the number of active users) the FH system can offer a significant improvement in terms of t/ 1 ), rj^ and r/ 4 ) 

1 I7 (3) 

(implying a more efficient usage of the spectrum). It is also shown that - < < 1, i.e., the loss incurred in 

e Ifd 

terms of ?/ 3 ) is not more than -. 
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Interference, Multiplexing Gain. 

I. Introduction 

A. Motivation 

Increasing demand for wireless applications on one hand, and the limited available resources on the 
other hand, provoke more efficient usage of such resources. Due to its significance, many researchers 
have addressed the problem of resource allocation in wireless networks. One major challenge in wireless 
networks is the destructive effect of multi-user interference, which degrades the performance when multiple 
users share the spectrum. As such, an efficient and low complexity resource allocation scheme that 
maximizes the quality of service while mitigating the impact of the multi-user interference is desirable. The 
existing resource allocation schemes are either centralized, i.e., a central controller manages the resources, 
or decentralized, where resource allocation is performed locally at each node. Due to the complexity of 
adapting the centralized schemes to the network structure (e.g. number of active users), these schemes are 
usually designed for a fixed network structure. This makes inefficient usage of resources because, in most 
cases, the number of active users may be considerably less than the value assumed in the design process. 
On the other hand, most of the decentralized resource allocation schemes suffer from the complexity, 
either in the algorithm (e.g. game-theoretic approaches involving iterative methods) or in the hardware 
(e.g. cognitive radio). Therefore, it is of interest to devise an efficient and low-complexity decentralized 
resource allocation scheme, which is the main goal of this paper. 

B. Related Works 

1) Centeralized Schemes: In recent years, many centralized power and spectrum allocation schemes 
have been studied in cellular and multihop wireless networks [l]-[8]. Clearly, centralized schemes perform 
better than the decentralized (distributed) approaches, while requiring extensive knowledge of the network 
configuration. In particular, when the number of nodes is large, deploying such centralized schemes may 
not be practically feasible. 

Traditional wireless systems aimed to avoid the interference among users by using orthogonal transmis- 
sion schemes. The most common example is the Frequency Division (FD) system, in which different users 
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transmit over disjoint frequency sub-bands. The assignment of frequency sub-bands is usually performed 
by a central controller. Despite its simplicity, FD is shown to achieve the highest throughput in certain 
scenarios. In particular, [9] proves that in a wireless network where interference is treated as noise (no 
multi-user detection is performed), if the crossover gains are sufficiently larger than the forward gains, FD 
is Pareto-rate-optimal. Due to practical considerations, such FD systems usually rely on a fixed number 
of frequency sub-bands. Hence, if the number of users changes, the system is not guaranteed to offer the 
best possible spectral efficiency because, most of the time, the majority of the potential users may be 
inactive. 

2) Decentralized Schemes: In decentralized schemes, decisions concerning network resources are made 
by individual nodes based on their local information. Most of decentralized schemes reported in the liter- 
ature rely on either game-theoretic approaches or cognitive radios. Cognitive radios [10] have the ability 
to sense the unoccupied portion of the available spectrum and use this information in resource allocation. 
Fundamental limits of wireless networks with cognitive radios are studied in [1 1]— [14]. Although cognitive 
radios avoid the use of a central controller, they require sophisticated detection techniques for sensing 
the spectrum holes and dynamic frequency assignment, which add to the overall system complexity [15]. 
Noting the above points, it is desirable to have a decentralized frequency sharing strategy without the 
need for cognitive radios, which allows the users to coexist while utilizing the spectrum efficiently and 
fairly. 

Being a standard technique in spread spectrum communications and due to its interference avoidance 
nature, hopping is the simplest spectrum sharing method to use in decentralized networks. As different 
users typically have no prior information about the codebooks of the other users, the most efficient method 
is avoiding interference by choosing unused channels. As mentioned earlier, searching the spectrum to 
find spectrum holes is not an easy task due to the dynamic spectrum usage. As such, Frequency Hopping 
(FH) is a realization of a transmission scheme without sensing, while avoiding the collisions as much as 
possible. Frequency Hopping is one of the standard signaling schemes [16] adopted in ad-hoc networks. In 
short range scenarios, bluetooth systems [17]— [19] are the most popular examples of a Wireless Personal 
Area Network (WPAN). Using FH over the unlicensed ISM band, a bluetooth system provides robust 
communication to unpredictable sources of interference. A modification of Frequency Hopping, called 
Dynamic Frequency Hopping (DFH), selects the hopping pattern based on interference measurements in 
order to avoid dominant interferers. The performance of a DFH scheme when applied to a cellular system 
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is assessed in [20]-[22]. 

In [23], the authors consider the problem of bandwidth partitioning in a decentralized wireless network 
where different transmitters are connected to different receivers through channels with similar path loss 
exponent. Assuming the transmitters are scattered over the two dimensional plane according to a Poisson 
point process, a fixed bandwidth is partitioned into a certain number of sub-bands such that the so-called 
transmission intensity in the network is maximized while the probability of outage per user is below a 
certain threshold. The transmission strategy is based on choosing one sub-band randomly per transmission, 
which is a special case of FH. 

Frequency hopping is also proposed in [14] in the context of cognitive radios, where each cognitive 
transmitter selects a frequency sub-band but quits transmitting if the sub-band is already occupied by a 
primary user. 

Recently, Orthogonal Frequency Division Multiplexing (OFDM) has been considered as a promising 
technique in many wireless technologies. OFDM partitions a wide-band channel to a group of narrow- 
band orthogonal sub-channels. The popularity of OFDM motivates us to consider a Frequency Hopping 
scheme operating over u narrow-band orthogonal frequency sub-bands. We note that the results of the 
paper are valid in a general setup where hopping is performed over an arbitrary orthogonal basis. To make 
the presentation as simple as possible, we take the orthogonal basis in frequency, which can be realized 
in practice using OFDM systems. 

C. Contribution 

In this paper, we consider a decentralized wireless communication network with a fixed number u of 
frequency sub-bands to be shared among N transmitter-receiver pairs. It is assumed that the number of 
active users is a random variable with a given probability mass function. Moreover, users are unaware 
of each other's codebooks, and hence, no multiuser detection is possible. We propose a randomized 
Frequency Hopping scheme in which the i th transmitter randomly hops over Vi out of u sub-bands from 
transmission to transmission. Assuming i.i.d. Gaussian signals are transmitted over the chosen sub-bands, 
the distribution of the noise plus interference becomes mixed Gaussian, which makes the calculation of 
the achievable rate complicated. The main contributions of the paper are: 

• We derive lower and upper bounds on the mutual information between the transmitted and received 
signals of each user and demonstrate that, for large SNR values, the two bounds coincide. Thereafter, 
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we are able to show that the achievable rate of the i th user scales like f f[j=i (l - ?) logSNR. 

• We show that each transmitter only needs the knowledge of the number of active users in the 
network, the forward channel gain and the maximum interference at its desired receiver to regulate 
its transmission rate. Knowing these quantities, we demonstrate how the i th user can achieve a 
multiplexing gain of f [TjLi (l - ^). 

• We obtain the optimum design parameters {vi}f =1 in order to maximize various performance mea- 
sures. 

• We compare the performance of the FH with that of the Frequency Division in terms of the following 
performance measures: average sum multiplexing gain (r/ 1 * 1 ), average minimum multiplexing gain 
per user (t]^), minimum nonzero multiplexing gain per user (rj^) and service capability (rj^). We 
show that (depending on the probability mass function of the number of active users) the FH system 
can offer a significant improvement in terms of t/ 1 ), rf 2 \ and 77 ( 4 ) (implying a more efficient usage 

(3) 

of the spectrum). It is also shown that - < %f < 1, i.e., the loss incurred in terms of m 3 ' is not 

e Ifd 

more than -. 

e 

The paper outline is as follows. The system model is given in section EL Section III offers an analysis 
of the achievable rates. Upper bounds and lower bounds on the achievable rates of users are presented in 
this section. In section IV, based on the results in section III, we discuss how users in the FH system can 
fairly share the spectrum. Comparison with the FD scheme in terms of different performance measures 
is discussed in section V. Section VI offers a comparison between two versions of the proposed FH, i.e., 
the robust frequency hopping and adaptive frequency hopping. Finally, section VII states the concluding 
remarks. 

D. Notation 

Throughout the paper, we use the notation E{.} for the expectation operator. Pr{£} denotes the 
probability of an event E, 1(E) the indicator function of an event E and px(-) the probability density 
function (PDF) of a random variable X. Also, l(X; Y) denotes the mutual information between random 
variables X and Y and h(X) denotes the differential entropy of a continuous random variable X. Finally, 
the notation 7(7) ~ g{j) implies lim 7 _ +00 ^ = 1. 



II. System Model and Assumptions 

We consider a wireless network with N users^ operating over a spectrum consisting of u orthogonal 
sub-bands. The number of active users is assumed to be a random variable with a given distribution, 
however, it is fixed during the whole transmission once it is set first. The transmission blocks of each user 
comprise of an arbitrarily large number of transmission slots. We remark that the results of this paper are 
valid regardless of having block synchronization among the users, however, we assume synchronization 
at the symbol level. It is assumed that the i th user exploits t>;(< u) out of the u sub-bands in each 
transmission slot and hops randomly to another set of Vi frequency sub-bands in the next transmission 
slot. This user transmits independent real Gaussian signals of variance — over the chosen sub-bands, in 
which P denotes the total average power for each transmitter. Each receiver is assumed to know the 
hopping pattern of its affiliated transmitter. It is assumed that the users are not aware of each other's 
codebooks and hence, no multiuser detection or interference cancelation is possible at the receiver sides. 
The static and non-frequency selective channel gain of the link connecting the i th transmitter to the j th 



receiver is shown by hij. As it will be shown in (45 ), the only information each transmitter needs in order 



to regulate its transmission rate (focusing on the achieved multiplexing gain) is its forward channel gain, 
the maximum interference level at its associated receiver and the number of active users in the network. 
This information can be obtained at the receiver side by investigating the interference PDF and provided 
to the corresponding receiver via a feedback link. 

As all users hop over different portions of the spectrum from transmission slot to transmission slot, 
no user is assumed to be capable of tracking the instantaneous interference level. This assumption makes 
the interference plus noise PDF at the receiver side of each user be mixed Gaussian. In fact, depending 
on different choices the other users make to select the frequency sub-bands and values of the crossover 
gains, the interference on each frequency sub-band at any given receiver can have up to 2 7V ~ 1 power 
levels. The vector consisting of the received signals on the frequency sub-bands at the i th receiver in a 
typical transmission slot is 

*i = hi^Xi + Zi, (1) 

where Xi is the u x 1 transmitted vector and Z± is the noise plus interference vector at the receiver side 
of the i th user. Due to the fact that each transmitter hops randomly from slot to slot, one may write Px (■) 

'Each user consists of a transmitter-receiver pair. 
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as 

Px^) = 7^\9u(x,C), (2) 

which corresponds to the mixed Gaussian distribution. In the above equation, g u (x,C) denotes the PDF 
of a zero-mean u x 1 jointly Gaussian vector of covariance matrix C and the set £ includes all u x u 
diagonal matrices in which Vi out of the u diagonal elements are ^ and the rest are zero. Denoting the 
noise plus interference on the j th sub-band at the receiver side of the i th user by Z^j (the j th component 
of Zi), it is clear that p Zi .(.) is not dependent on j. This is due to the fact that the crossover gains are not 
frequency selective and there is no particular interest to a specific frequency sub-band by any user. We 
assume there are Li + 1 (Li < 2 Ar_1 — 1) possible non-zero power levels for Z^j, say {of J^! . Denoting 
the occurrence probability of of; by a it i, Vz itj {-) identifies a mixed Gaussian PDF as 

pz - (2)= Sv§^ exp (-4;)' <3) 

where o 2 = o 2 < of x < o 2 2 < ... < af L (o 2 is the ambient noise power). We notice that for each 
/ > 0, there exists a c iy i > such that o 2 ; = o 2 + Q /P where = Cj < Q,i < Q,2 < ••• < c i,u- ^ ne ma y 
write Zij = J2k=i tkjhk^Xkj + v%,j where e^j is a Bernoulli random variable showing if the k th user 
has utilized the j th sub-band, Xkj is the signal of the k th user sent on the j th sub-band (assuming it has 
utilized the j th sub-band), and is the ambient noise which is a zero-mean Gaussian random variable 
with variance o 2 . The ratio ^ is taken as a measure of SNR and is denoted by 7 throughout the paper. 

III. Analysis of the Achievable Rate 

Let us denote the achievable rate of the i th user by It can be observed that the communication 
channel of this user is a channel with state Si, the hopping pattern of the i th user, which is independently 
changing over different transmission slots, and is known to both the transmitter and the receiver. The 
achievable rate of such a channel is given by 

&i = l(X t ;Y t \S t ) = J2 Pr 0$ = s l )l(X l ;Y t \S l = 8i ), (4) 

where \{Xi\ Yi\Si = Sj) is the mutual information between X^ and % for the specific sub-band selection 
corresponding to Si = s». The set &i denotes all possible selections of Vi out of the u sub-bands. As 
pg.{.) is a symmetric density function, meaning all its components have the same PDF given in (T3l), we 
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deduce that IpQ; Y^Si = Sj) is independent of Sj. Therefore, to calculate M{, we may assume any specific 
sub-band selection for the i th user in &i, say the first vi sub-bands. Denoting this specific state by s*, we 
get 

& i = I(X i ;Y i \S i = s* i ). (5) 
In this case, we denote Yi and Xi by Yi(s*) and Xi(s*), respectively. Obviously, we have 

M t = l(Xi(s*); Yiis*)) = h(Yi(s*)) - h(Z i ). (6) 

Because Y^s*) and Z; L have mixed Gaussian distribution, there is no closed-form expression for the 
differential entropy of these vectors. As such, we provide an upper bound and a lower bound on the 
achievable rate of each user in the following subsections and show that these bounds converge in the 
asymptotic high SNR regime. 

A. Upper Bound on The Achievable Rates 

In this section, we develop an upper bound Mi^ on the achievable rate of the i th user that is tight 
enough to ensure that — Mi does not increase unboundedly as SNR increases. The idea behind this 
upper bound is the convexity of M{ in terms of Vf^s^x^) (•!•)■ 

Theorem 1 There exists an upper bound on the achievable rate of the i th user given by 

«U = \vi n (l - |) log (l + + M ijnh (7) 

where lim 7 _^oo -^i,ub < oo- In particular, M^ ~ |w j Hfc=i (l ~~ if) 1°§7- 

Proof: Let Wj be the tixl interference vector where its component W^j is a random variable 
showing the interference term on the j th frequency sub-band at the receiver of the i th user. We have 
WiJ = J2k=i £kjhk,iXkj. Clearly, Wi is a mixed Gaussian random vector where the Gaussian components 
in its PDF represent different choices the other users make in selecting their sub-bands. In fact, we have 
PwS™) = MT^=i9u{w,D^ m ), where M; = U k ^i(v k ) and A,m = diag^, • • • ,(%%), in which 
^i)n = Yjs=\ e l,j\hk,i\ 2 ^ denotes the variance of Wij for the m th realization of {e k j} k ^i out of Mj 
possible realizations^] If the probability density function of the interference vector consisted only of 

2 Note that as each user transmits independent Gaussian signals over its chosen sub-bands, the matrices {D i im }mLi are diagonal. 



g u (w, Di, m ), the forward link of the i th user would be converted into an additive Gaussian channel. The 
achievable rate of such a virtual channel is given by 

! det (Cov(X 4 (s*)) + D i>m + a 2 I u ) 

<%>■ = - loe - - 

2 i0g det (A, m + ° 2 Iu) 

1 lli=l (^^— + d i,m + (7 

2 og ri^g^ 2 ) 



7 = 1 V 



|^| 2 P 



2 U v 



(8) 



One may also state this as follows. Let Tj m = | j : 1 < j < V{, = j. Then, 



%^logfl + fe^l + .*>,.,„. (9) 



where 



2 



(10) 



and |T im | denotes the cardinality of the set T im . As each nonzero af' m is proportional to P, it is clear 

that lim 7 ^oo M i)m < oo. We know that ^ is convex in terms of Vf^s^x^)^^) = Pz.iv ~ h^x) [25]. 

i 

Mi 



Noting this and the fact that pg.{z) = ^ J2mU 9u(z, A,m + ^h), we have 



m=l \ m=l / v 7 



where ^ iU b = ^ Sm=i ^>m- Clearly, as each ^ i)m saturates by increasing 7, one has lim^oo ^ jU b < 00. 
The following Lemma offers an explicit expression for J2m'=i \Ti, m \- 



Lemma 1 

Mi N 



^rYl\Ti, m \=v i f[(l 



i - LJ - V it 

m=l k=l 



(12) 



Proof: Defining A it j = {m : 1 < m < Mi, \T itTn \ = j} for each 1 < i < N and 1 < j < Wj, one may 
express the left-hand side of ( fl~2| ) as 

1 m=l 1 j=l 
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Let Fi be a random variable showing the number of interference-free sub-bands among the Vi sub-bands 



selected by the i th user. Using (48) and noting that Pr{Fj = j} = Mr^-, 



Mi 

Mi Vi 
m=l j=l 



(14) 



Let us define 

, [ 1 w i i = 

^ < " (15) 

Wij^O 

for any 1 < % < N and 1 < j < v^. Obviously, Fj = X^Jli ^ij- As sucn > 

Vi Vi 

E{F t } = £ E{F M } = £ = °}- ( 16 ) 

j=i i=i 

Since Pr{e fei , = 1} = ^, 

iV JV 



Pr{V^j- = 0} = Pr-fZ^ contains no interference} = JJ Pr{e fcii = 0} = JJ (l - -) . (17) 
This yields 



fc=i fe=i 



E{^}=^n( 1 -^)' ^ i8) 

which completes the proof of Lemma 1. 



k=l 

k+i 



Based on (11 ) and Lemma 1, the proof of Theorem 1 is complete. 



B. Lower Bound on the Achievable Rates 

In this section, we derive a lower bound on the achievable rates of users. The idea behind deriving 
this lower bound is to invoke the classical entropy power inequality (EPI). As we will see, this initial 
lower bound is not in a closed form as it depends on the differential entropy of a mixed Gaussian random 
variable. In appendix A, we obtain an appropriate upper bound on such an entropy which leads to the 
final lower bound on Mi. 

Theorem 2 There exists a lower bound Mijb on the achievable rate of the i th user which can be written 

1 N 

2 v *n( i -^) i °s^ + ^» (i9) 



as 

N 



k=l 

k^i 
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such that Hindoo e^ib < oo. In particular, ~ \vi \\k=\ (l — ^f) log 7. 

Proof: We define X[ to be the v i x 1 signal vector corresponding to the first i>, elements of Xi(s*). 
Clearly, X[ is a Gaussian vector with covariance matrix ^I Vi . Let F/ = hi^X[ + where is the noise 
plus interference vector at the receiver side of the i th user on the first Vi sub-bands. Using entropy power 
inequality, we have 

2 v i 1 > 2 "i ' 1 + 2 u » . (20) 



— h(Z') 

Dividing both sides by 2^ ' , we get 



h(Y/) - h(fO > I log ^(M^')-M^)) + ^ (21) 
On the other hand, since Y- is a subvector of Yi(s*), we have 

^ = l(Ms*); jfo?)) > F/) = h(F/) - h(ij). (22) 
Comparing (21) and ( [22] ) yields 

^^llog^^^-^+l). (23) 

Clearly, h(/ij jX 4 ') = y log ^2iie ^ hl '^ P J . As Z[ is a mixed Gaussian random vector, there is no closed- 
form formula for h(Z-). Hence, we have to find an appropriate upper bound on fi(Z 4 ') to further simplify 



(23). Using the chain rule for the differential entropy, we obtain 



h$)<5>(Zy). (24) 

Recalling the definitions of {flj,/}^ and {c iy i}fl in the system model, the following Lemma yields an 
upper bound on h(Zjj) for each 1 < j < v%. 

Lemma 2 For every 1 < j < and for all values ofj, there exists an upper bound on h(Z it j) given by 

HZ id ) < \og{c iMl + 1) + \og(V2^a) + M>i (25) 

where Mi = - J2i=o a hi lo § 

is the discrete entropy of {oi,/}^=o- 
Proof: See Appendix A. ■ 
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By (25), (24) and (23), 




) 



(26) 



Defining ^ i)lb = f log I — _ 1 ':' 1 L a . + 7~ ai <° ) , we note that Hindoo M it i h < oo. Combining this with 



In [24], we address another approach to propose a lower bound on the achievable rate of the i user with 
the same SNR scaling as ^lb- 

One may consider the following generalization of the FH scheme. Let us assume that the users are 
not restricted to choose a fixed number of frequency sub-bands in each transmission slot. In fact, in 
each transmission slot the number of selected sub-bands can be any integer between and u, and the 
probability of choosing v 6 [0, u] H Z sub-bands by the i th user is denoted by fii >v . Therefore, the i th 
user has two random generators. The first random generator selects a number < v < u according to 
the probability mass function }" =0 , while the other generator selects v sub-bands among the whole 
available u sub-bands. This repeats independently from transmission slot to transmission slot. Based on 
the arguments made in section II, the achievable rate of the i th user can be written as 



the fact that a ij0 



= Y[k=i (l — ^7) completes the proof of Theorem 2. 



o 




(27) 



v=0 
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where s* v denotes the state where the i th user selects the first v sub-bands. Clearly, l(Xi(s* );Yi(s* )) = 
for any 1 < i < N. Furthermore, 



a i,0 



Pr | A given component of Z\ contains no interference 

u u u u N 

E - E E ■■■EIW 1 



u 

fi=0 tii_i=0 Vi+i=0 i;jv=0fc=l 

k^i 

N u 

n E ^ ( l ~ v i 

k=l v k =0 
k^i 

N u 

k=l v=0 
k^i 

N 



U 
k=l 

k^i 



where v k = Y^v=o v f J, k,v Based on the results of this section, we get 



I(X i «J;F i «J)~^a ii olog 7 . (29) 



Using (27), (28) and d29j yields 



u N 



v=0 k=l 
k^i 

1 N 

= ihlK 1 -^) 10 " (30) 

k=l 

k^i 

In fact, ( |30| ) demonstrates that the generalized FH scheme is equivalent to the FH scheme through 
substituting {vi]f =1 by {vi}f =l . However, it is remarkable that in contrast to the FH scheme in which 
{vi]f =l are integer values, in the generalized FH scheme {vi]f =1 are real values. This provides more 
flexibility in system design. The above observation motivates us to use the generalized scenario in the 
sequel and we simply refer to it as the FH scheme. In this scheme, the i th user has a parameter Vi, which 
can be chosen to be any real number in the interval [Q,u]. 
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IV. System Design 

In this section, we find the optimum operation point for the FH scheme. This requires finding the 
optimum values of {vi]f =1 . Based on the results established in the previous section, there exist upper and 
lower bounds on the achievable rate of each user that coincide in the high SNR regime. As such, the 
achievable rate itself must be asymptotically equivalent to each of these bounds, i.e., 



i N 



k=l 

k^i 



Vh 



u 



log 7, 



(31) 



where, based on the conclusion made at the end of section III, the parameters {w;}^ can be adjusted to 



be any real number in the range [0,u]. By (31 ), the network sum-rate can be asymptotically written as 



where 



N 

E- 



SMG fa, 



SMG Oi, ■ • • ,v N ) log 7, 



VN 



N N 



k=l 

k^i 



Vk 

u 



(32) 



(33) 



We call SMG (vi, ■ ■ ■ ,vn) the sum multiplexing gain of the system. SMG (vi, ■ ■ ■ ,vn) is a symmetric 
function of (v\, ■ ■ ■ ,vn) and has a saddle point at Vi = ^ for 1 < i < N. In a fair FH system, it is 
required that — v for all 1 < i < N where v is any real number in the interval [0, u). Hence, we define 



SMG(i;,A0 ^SMG(ui, 



Maximizing this in terms of v yields 



.v N 



N 



-v 1 



Vi:Vi=v 



U , 



■Jopt 



U 

N' 



(34) 



(35) 



Computation of t> opt requires that all transmitters know the number of active users N in the network. As 
far as all channel gains are realizations of independent and continuous random variables, the number of 
power levels in the PDF of noise plus interference on any frequency sub-band at the receiver side of any 
user is almost surely equal to 2 iV ~ 1 . Therefore, any receiver can identify N and send it to its corresponding 
transmitter through a feedback link. 
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Setting v = v opt , the highest sum multiplexing gain of the fair FH scheme is given by 



sup SMG(v,N) = l -u (l-i 



N-l 



(36) 



It is remarkable that j| may not be a positive integer. If we do not adopt the generalized FH scheme, 
then all users must hop randomly over sets of v = max{[^J,l} frequency sub-bands. This results in 
a sum multiplexing gain of |j; (l — -) \ This is, in general, less than \u (l — h~) N \ By adopting 
the generalized FH scheme in case J| ^ Z, each user only needs to hop randomly over different sets of 
frequency sub-bands of cardinality |_]|J or In fact, each user has two random generators. The first 
random generator selects one of the numbers |_^J and with probabilities /i and 1 — /i, respectively, 
such that /iL^J + (1 ~ A 4 ) \ = n or equivalently \i = \^] — Let us assume the first random generator 
has selected a number a E { [^J , \jjf \ }. Then, the second random generator selects a subset of cardinality 
a among the u frequency sub-bands. Doing this independently from transmission slot to transmission slot, 



the sum multiplexing gain given in (36) is achieved. 

Observation 1- One might suggest another well-known utility function that is popular in the game 
theory context, namely the proportional fair function, which is defined as ^j =1 log^ . We have 



5> 



N 



5> 



i=l 



i=l 



A' 



/ 



/ 



N 



\ 



i=l 



n 

fc=i 

N 

no 

fc=i 



li 

it 



log 7 



+ log log 7. 



(37) 



maximum at vi 



1 for 



It can be easily verified that ^=1 1°S ( \ v i Y\.k=i (l — ^7) ) has an absolute 

1 < i < N. 

Observation 2- As we will discuss in more detail in the next section, the number of active users in the 
system is in general a random variable. Although users in the FH system can use their knowledge about 
the number of active users to adjust the hopping parameter (as explained earlier in this section), one may 
devise a sub-optimal rule to fix v = v* given by 



v* = arg max E {SMG(w, N)} 

vE[0,u] 



(38) 



where the expectation is with respect to the number of active users in the network. This selection of v 
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by all users makes the system robust against changes in the number of active users in the networl^ We 
call this version of the FH system the robust Frequency Hopping. In fact, in the robust FH scenario, there 
exists a global hopping parameter v where all users hop over a number v of the u frequency sub-bands. 



We remark that the rule in (38) is a particular design approach for the robust FH system. In the next 
section, we consider another design rule based on maximizing the average of the minimum multiplexing 
gain per user in term of the number of active users in the network. 

V. Comparison of the robust FH scenario with the FD scheme 

In a centralized setup, under the condition that no user is aware of the other users' codebooks and 
the number of users is fixed and known to the central controller, it is shown in [9] that if the crossover 
channel gains are sufficiently larger than the forward channel gains, then every Pareto optimal rate vector 
is realized by Frequency Division for all ranges of SNR. However, in realistic scenarios, the number of 
active users is not fixed. This degrades the performance of the FD scheme as it is designed for a specified 
number of users. In particular, if the number of active users is less than the designed target of the FD 
scheme, a considerable portion of the spectrum may remain unused. This encourages us to compare the 
performance of the proposed robust FH scheme with that of the FD scheme in a setup where the number 
of active users is a random variable with a given distributioij^J 

To perform the comparison, we introduce four different performance measures. In the following defini- 
tions, the sup operation is over possible adjustable parameters in the system, e.g., the hopping parameter in 
the FH scenario. All expectations are taken with respect to N. We define q n = Pr{iV = n} for all n > 0. 
It is assumed that the maximum number of active users in the network is n max , i.e., Pr{iV > n max } = 0. 
We usually take q = unless otherwise stated. 

• Average sum multiplexing gain, which is defined as 

= sup lim — l — >- = sup E {SMG} , (39) 

7^00 log 7 

where SMG = lim^oo - is the sum multiplexing gain. 

3 In fact, the transmitters use their knowledge about the instantaneous number of active users only to regulate their transmission rate. This 



is explained in more details in ( |45| . 

4 Note that, as explicitly mentioned in the system model, the number of users is assumed to be fixed for the whole transmission period of 
interest. 
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Average minimum multiplexing gain per user, which is defined as 

(2) a i:~ E{min 1 <i< A r<^'i} 



rp ' = sup lim . (40) 

7^00 log 7 

• Minimum nonzero multiplexing gain per user, which is defined as 

rr l J = min min lim (41) 

n:g n /0 N SCIV =n 7^00 log 7 
l<j<n 

where A^ serv denotes the number of active users receiving service (i.e., their multiplexing gain is 
strictly positive). 

• Service capability, which is defined as 

?/ 4) ^su P E{^p}. (42) 

The FD system is designed to service, at most, a certain number of active users. We denote this design 
target in the FD scheme by n dcs . Therefore, the spectrum is divided to n dcs bands where each band contains 
frequency sub-bands. This requires that u is divisible by rides, which is assumed to be the case to 
guarantee fairness. Each user that becomes active occupies an empty band. If there is no empty band, 
no service is available. In case n max is finite, the central controller in the FD system sets n des = n max 
to ensure that all users can receive service upon activation. In case n max is not a finite number, the 
central controller sets n des = u to guarantee that as many users receive service as possible. Therefore, 
ndes = nim{ri max , u}. In fact, we will show that selecting rides = niin{n max , u] maximizes the service 
capability in the FD system. 

We remark that due to the nature of the robust FH scheme, as far as users hop over a proper subset of 
size v of the u sub-bands, all users receive service, while if v = u and iV > 1, no user receives service, 
i.e., the multiplexing gain achieved by any active user is zero. As such, to get the largest service capability 



in the FH scenario, we require v E (0, u). As an example, if v* in (38 ) is equal to u, the service capability 
will be less than 1. To avoid this, we set the global hopping parameter v = v* — e = u — e for sufficiently 
small e such that the performance of the robust FH is still above the performance of the FD scenario. 
• Average sum multiplexing gain 

This measure is a meaningful tool of comparison if rr max < oo. Hence, we assume n max is a finite 
number and u is a multiple of n max in this subsection. It is easily seen that the sum multiplexing gain in 
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the FD scenario is 



SMG FD (n des ,iV) 



N u 
2 "dc. 



N < n des 
N > n des 



(43) 



Noting (34), SMG F n(v,N) is given by 



SMG F h(v,N) 



1 / V^N-l 

-Nv ( 1 - 

2 V u, 



(44) 



Since the number of active users N is a global knowledge, all users can choose v = v opt — % to achieve 
the maximum sum multiplexing gain. However, as mentioned earlier, a robust hopping strategy against 



changes in the number of active users is the one given in (38). It is notable that although the value of 



v is fixed at v* , all users regulate their rates based on the instantaneous number of active users to avoid 
transmission failure. Using the lower bound on the achievable rate of the i th user given in (26), the i th 
user selects its actual rate R 4 as 



/ 



R; 



log 



(l-^)- 2(7V - 1)(l ^ } |^| 2 7 



\ 



V 



1 + 



l-i- 



u ) 



+ 1 



(45) 



th 



It is seen that the quantities the i th transmitter needs to evaluate Ri are \h it i\, Ylj^i \ hj,i\ 2 an< ^ N. The i 
receiver sends these required data to the transmitter via a feedback link. 

We present an example to compare the performance of FH with that of FD in terms of r/ 1 ). 

Example 1- Let us consider a network where n max = 2. The central controller in the FD system sets 
n des = 2, and according to 4d = E{SMG FD (2, iV)} = qij + g 2 f = qi± ^ 1 u. Based on Q, 



E{SMGfh(^, N)} = \qiv + q 2 v (l - l). Using this in (38), 



arg max E{SMG FH (f , A^)} 

v<=[0,u] 



gi <2q 2 



u 



qi > 2g 2 



(46) 



Therefore, 



7$>= sup E{SMG PH (« J iV)} = E{SMG P H(v* J iV)} 



(gi+2g 2 ) 2 



16^2 
'/I 



u qi < 2q 2 
u qi> 2q 2 



(47) 



It is easy to see that r^pj > if and only if q x > 2q 2 , or equivalently, q\ > |. We note that in this case 
v* = u, i.e., all users spread their power on the whole spectrum and no hopping is performed. This makes 



,(i) 
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service capability be strictly less than 1 because, if both users are active, non of them receive service. As 
such, we take v = u — e. To ensure that the performance of the robust FH scenario is above that of the 
FD system, we require 

\ qi (u -e) + q2 (u- e) (l - ^) > *±**«. (48) 



1_M l-i 

As far as s < ^, (48 ) is equivalent to qi > 2q 2 — " • This is a more restrictive condition than g x > 2q 2 



which is the cost paid for having full service capability. However, for e <C u the two regions of (qi, q 2 ) 
are almost the same. □ 

In [24], it is shown that in case n max = 3, there exists a probability set of (qi,q 2 ,qs) on the number 
of active users that makes FH achieve a higher performance compared to FD in terms of r/ 1 ) while v* is 
strictly less than u. 

• Average minimum multiplexing gain per user 

This measure can also be written as 

r/ 2 ) = sup E | ^l(jV serv = N) } . (49) 



In fact, if N SCIV ^ N, there exists at least one user that achieves no multiplexing gain. Therefore, the 
minimum multiplexing gain per user is zero in this case. However, if A^ serv = N, all users achieve a 
nonzero multiplexing gain. This measure can be used whether n max is finite or infinite. 

In case of the FH scenario, the rule to choose the optimum value of the global hopping parameter v, 
denoted by v\ is given by 

«t = acg max e( SMGf ^ ^ 1(^ = ^)1. (50) 
«e[o,«] [ iv J 



In this case, the actual transmission rate of the i th user is given by (45) where v* is replaced by . 



Example 2- Considering the same setup in example 1, as n max < oo, we have A^ serViFD = N. Hence, 
we have 77^ = + ^|g 2 = f- In case of the FH scheme, 

1 N = 1 or (N > 1 and v ^ u) 
1(AWh = N) = { . (51) 

oth. 
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Hence, 



+e{ SMG ^ ( "- JV) 1(^„ = JV)|JV = 2 } Pr{N = 2} 

1 1 / v\ 

= 2 qiV + 2 q2V V ~ u) 1 ^ ^ ^ 

tfif + (l - -V (52) 



2 J 2" V u 



Hence, 



which yields 



v' = ar 



g max \qiv + q 2 v ( 1 - - ] } , (53) 

u6(0,u] I V M/ J 



, t- 2q 2 > 1 

^ = <; 292 . (54) 

u 2q 2 <l 



As such, 



, n I ^-u 2q 2 > 1 
&={ 892 • (55) 

[ \q x u 2q 2 < 1 

(2) (2) 1 

It is easy to see that 77^ > 77^ if and only if 2q 2 < 1, or equivalently q\ > ±. However, in this case 
= u. Hence, to make the service capability be 1, we choose the global hopping parameter v — u — e. 
To ensure that FH still outperforms FD in terms of the average minimum multiplexing gain per user, we 
require, 

- qi (u - e) + -q 2 (u - e) f 1- — —J > -. (56) 



This is equivalent to 2q 2 < -^r ^1 — ^f~ry^ • ^ 



(2) (2) + 

In the next example, we provide a case where 77^ > r] Fr ] while v T is strictly less than 



u. 



Example 3- Let n max < 00. In this example, we aim to derive a sufficient condition on {q n }n=T such 

that 4h > 4d or 4h > 4d- 

Case 7- Let us consider the measure rp-\ We have the following result. 



Proposition 1 As far as 



E{N}< iln((e 2 -lK iax ), (57) 
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we have 77^ < 77^. 



Proof: See Appendix B. 



For example, if n max = 2, (57) gives E{iV} < 1.274, or equivalently qi > 0.726. By example 1, we notice 



that ?7pjj > 77^5 if and only if q\ > 0.667. 



Case 2- As for r/ 2 \ along the same lines leading to (57), a sufficient condition for 77^ > 77^ is given 
in the following Proposition. 



Proposition 2 As far as 



we have 77^ < 77^. 



E{N}-1 

E{iV} ^ ~ E{iV} J 



1 Xi^iiVJ— 1 1 

> , (58) 

^ma\ r 



Proof: See Appendix C. ■ 

For example, if n max = 10, qi = 0.22, q 2 = q% = q^ = 0.24 and q 5 = q 6 = ■ ■ ■ = q w = 0.01, one 



~ (2) (2) 

has E{iV} = 2.78, which satisfies (58). Therefore, we conclude 77 Ft j > 77^. Computing these quantities 

(2) 

directly, we get 77^ = y| and 



, , 10 

1 / vx 71 - 1 



77ph = - max < v q n (l 

K. n=l 

(a) 1 



u max (1 - u v ) (0.22 + 0.24(u;„ +u% + oo 3 v ) + 0.01(^ +uj 5 v +uj 6 v + uj 7 v + uj 8 v + uj 9 v )) 
2 w„e[o,i] 

= 0.1121m (59) 

where in (a), we define u v = 1 — - and (b) is obtained by setting u v = 0.28, or equivalently v = 7/ = 
0.72u. This yields 41 = 1.7936. 

Example 4- In this example, we assume a Poisson distribution on the number of active users, i.e., 
Qn = e ^ A " , n > 0. This assumption corresponds to the scenario where potentially a large number n max of 
users may share the spectrum. However, the activation probability p of each user is very small. One can 
well approximate the number of active users in the network by a Poisson random variable with parameter 
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A = pn max . We have 



f SMG FH (^AQ 
\ N 



serv,FH 



N) 



(a) f SMG FH (^AQ 
\ iV 



1 e _A A n 



E 

71=1 



oo 



V 1- 



71— 1 



(6) 



e~ x \ n 



u n=l 



ni 



1 - 



V 



,A(^-«-i)_ a 



21- i 

e~ A (l - w„) (e A< ^ - l) 
2u;„ 



(60) 



In the above equation, (a) results from the fact that l(iV scrVi FH = N) = whenever v = u and iV > 1, 
however, SMGfh(^, N) = in this case, (b) follows by the fact that E{e tN } = e A ^ e '~^ for any t and 
uj v = 1 — - as defined in example 3. It can be easily seen that the optimal cu v satisfies the nonlinear 



equation e 



-\lu v 



1 — \uj v + XujI- Solving this for cu v , we find out that is not equal to u for all A > 2. 



The following table lists the optimum values of u v , i.e., u v u the values of and also the corresponding 

(2) 

average minimum multiplexing gain per user 77^ for A G {3, • • • ,10}. 



A 


3 


4 


5 


6 


7 


8 


9 


10 




0.4536 


0.6392 


0.7347 


0.7912 


0.828 


0.8537 


0.8727 


0.8873 




0.5464m 


0.3608m 


0.2653m 


0.2088m 


0.1720m 


0.1463m 


0.1273m 


0.1127m 


(2) 

Vfr 


0.0869m 


0.0615m 


0.0467m 


0.0374m 


0.0311m 


0.0266m 


0.0232m 


0.0206m 



(61) 



In order to provide fairness among the users, the FD system tries to serve as many users as it can. 
Since it is not possible to serve more than u users and n max ^ u, the central controller sets nd es = u. 



Therefore, iV serv ,FD < N if and only if N > u. Using this and by (43) 

(SMG FD (n des ,iV) 



(2) 




N 

SMG FD (u,iV) 



N) 



71=1 



N 

e- x X n 
n\ 



■l(-^serv,FD 

N < m j Pt{N < m} 



(62) 



(2) (2) 

We have sketched T]p^ and r/p-^ in terms of A in fig. 1 and fig. 2 for the cases u = 7 and u = 20, 
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respectively. It is noticeable that 77^ scales linearly with u. However, 77^ is always less than | no matter 



(2) 



how large u is. Thus, as u increases, the advantage of FH over FD becomes more apparent. □ 




-•*■- FH 

— O— FD 



a 



--<»--'0--^ e -- 



10 12 14 16 



(2) (2) 

Fig. 1. Curves of r/p^ and rjp^ in terms of A in a network with it = 7 sub-bands. 



-■*■-■ FH 

— O— FD 
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-e— q~ 







10 12 14 16 18 20 



Fig. 2. Curves of and rj Fr \ in terms of A in a network with u = 20 sub-bands. 
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• Minimum nonzero multiplexing gain per user 

The minimum nonzero multiplexing gain per user is the smallest nonzero multiplexing gain that a 
user in the network attains for different realizations in terms of the number of active users. Assuming 
n max < oo, this happens when there are exactly n max active users in the system. As the FD system is 
already designed to handle the case where n max users are present in the network, the minimum multiplexing 

(3) 

gain per user is automatically higher in FD as compared to FH. Setting nd es = n m i«, we have = 
SMG FD ( M ,n max ) = In the cas£ of ppj we assume t hat a u users se i ec t v = _«__ Hence, ri§X = 

^MG^rrf ^ n \ / \ n max-l _ „(3) / \ n max - 1 

fhU — ' maxj = =-!*— (1- . Clearly, - < %r < 1 as ( 1 — ) approaches ± 

^max ^W max y W max y e ^?FD ^ n max y 6 

from above by increasing n max . Therefore, the loss incurred in terms of 77^ for the FH system is always 
less than -. 

e 

• Service capability 

Service capability demonstrates the fraction of users receiving service among the whole active users in 
the network. As mentioned earlier, a user is said to receive service whenever the achieved multiplexing 
gain of the user is nonzero. In the FD scenario, if iV > u, then a fraction of users cannot share the 
spectrum. However, in case Pr{iV < u} — 1, the FD scheme achieves the full service capability. As for 
the FH scheme, we already know that as far as all users hop over proper subsets of the sub-bands, every 
user achieves a nonzero multiplexing gain. The following examples offer comparisons between FD and 
FH in terms of the service capability. 

Example 5- In this example, we consider a setup where n max < 00. The central controller in FD simply 
sets ndcs = «max and the service capability is always equal to 1. The number of served users iV S e r v,FH in 
the FH scenario can be written as 

[ N N = 1 or (N > 1 and v ^ u) 
AWh = { ■ (63) 

[ oth. 

Therefore, as far as v 7^ u, we have iVgcrv.FH = N and the service capability is one. This shows that to 
achieve the maximum service capability in a system where n max > 1, the hopping parameter v must be 
strictly less than u. □ 

Example 6- In this example, we provide a case where n max is not finite. Let us assume the distribution 
of the number of active users in the network is a Poisson distribution with parameter A, i.e., q n = A " 6 , A 
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for n > where A > 1. Let us compute v* for the FH scenario. We have, 



1 ^ e~ x X n { / v\ n ~ 1 

e{smg F hKao} = jEirH 1 "^ 

n=l ^ 



(n-1)! V « 

n=l V y 

-Aw > — 1 (64) 

ra=0 

-Afe - ^. (65) 



Thus, 



u 

v* = argmaxE{SMG FH (w,A^)} = -. (66) 

v A 



Since A ^ 1, we get v* ^ u. Thus, choosing v = v* maximizes E | NscT ^ FH j and E{SMG F h(^, N)} 
simultaneously, i.e., r]^ = 1. 

In the FD system, iV scrViFD is given by 

j N N < n dcs 

^V"serv,FD = < • (67) 



^dcs 

N > n dc 



Thus, 



qn 
n 



E {e^xM = Pr{iV < ndcs} + ndcs | 

oo 

= l-Pr{N >n dcs + l} + n des 

= !- E ^i 1 —)- < 68 > 

™=™dcs+l 

By this expression, it is clear that to maximize E j Nsc ™< FU | ; one must select n dcs as large as possible. 
This basically justifies the assumption we made about selecting n dcs = u in the FD scheme in the case 
where n max is not finite. Thus, 

4^ = 1- E (69) 



n=u+l 



For instance, in the case of u = 5 and A = 3, we have 77^ = 0.9806. □ 
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VI. Adaptive Frequency Hopping 

The results of the previous section are obtained based on the assumption that the hopping parameter v 
is fixed and is not adaptively changed based on the number of active users. The performance of the FH 
system can be improved by letting the transmitters adapt their hopping parameter based on the number of 



active users using (35). We refer to this scenario as Adaptive Frequency Hopping (AFH). In the following 
example, we study the performance improvement offered by AFH over FH in terms of rf 1 ^ and r/ 2 \ 

Example 7- Let us assume that the number of active users is a Poisson random variable with parameter 
A > 1. We already have 

- £■ < 70 > 



while by (36), 



n=l 



Figure [3] shows the plots of rjp^ and ^afh versus A for u = 10. It is observed that 77^ does not change 
with A, while tTafh decreases by increasing A. This indicates that in a crowded network (large A), AFH 
does not provide any significant advantage over FH in terms of rf 1 '. 



1 2.2 



FH 
AFH 



~o~- ©-. 



10 12 

1 



Fig. 3. ??afh versus rff£ for u = 10. 
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(2) 

We have already calculated in example 4 in a system where 3 < A < 10. However, in case of 
AFH, 



(2) u^ e- x X n lf_ i 

n=l 



(72) 



Figure [4] presents the plots of 7^ and ?7afh versus A for it = 10. Both r/p^ and t/afh decrease by 

„(2) 

increasing A. However, the ratio -^ff decreases as A increases. This indicates that for large values of A, 
AFH does also not provide any significant advantage over FH in terms of 77 ( 2 K □ 



1.2 



--*-- FH 

-O— AFH 



Fig. 4. Vafh versus for u — 10. 



VII. Conclusion 

We have addressed a decentralized wireless communication network with a fixed number u of frequency 
sub-bands to be shared among N transmitter-receiver pairs. It is assumed that the number of active users 
is a random variable with a given distribution. Moreover, users are assumed to be unaware of each other's 
codebooks and hence, no multiuser detection is possible. We proposed a randomized Frequency Hopping 
(FH) scheme in which each transmitter randomly hops over subsets of the u sub-bands from transmission 
to transmission. Assuming all users transmit Gaussian signals, the distribution of noise plus interference is 
mixed Gaussian, which makes the calculation of the mutual information between the input and output of 
each user intractable. We derived lower and upper bounds on this mutual information and demonstrated 
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that for large SNR values, the two bounds coincide. This observation enabled us to compute the sum 
multiplexing gain of the system and obtain the optimum hopping strategy for maximizing this value. We 
compared the performance of the FH with that of the FD in terms of the following performance measures: 
average sum multiplexing gain (rj^), average minimum multiplexing gain per user (77^), minimum 
nonzero multiplexing gain per user (r/ 3 )) and service capability (7/^). We showed that (depending on the 
probability mass function of the number of active users) the FH system can offer a significant improvement 
in terms of rj^ and 77^ (implying a more efficient usage of the spectrum). It was also shown that 

(3) 

- < ^37 < 1, the loss incurred in terms of 77^ is not more than -. Moreover, computation of the 



so-called service capability showed that in the FH system any number of users can coexist fairly, while 
the maximum number of users in the FD system is limited by the number of sub-bands. 



Appendix A; Proof of Lemmas 2 



Let us consider a general ix 1 vector mixed Gaussian distribution p§(9) with different covariance 
matrices {Ci}[ =1 and associated probabilities {pi\i =1 given by 



L 




(73) 



1=1 



where g t (0,Q) 



(27r)2(dctC;)2 



1 



- cxp 



{-^Cf 1 ^}. Hence, 




(74) 



where Ji = pi J g t (9,Ci) \ogp^(9)d9 for 1 < I < L. To find a lower bound on Ji, we observe that 




m=l 




> Pi J g t (9,Q) log ( Pl g t (9,Q))d9 
= (pilogpi) [ g t (9,Q)d9 + Pl [ g t (9,Q) log g t (9,Q)d9 



(75) 
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Using this together with (74) yields 

h(6) = - J P§ (e)\ogp § (e)dB 

L 

= -£ J < 

1=1 

< - Pl \og Pl - Pl J 9t (9, Ci) log g t (9, Q)d6 



L 

(a) 



J2 Pl logp, + i ^ p, log ((2vre)* det C,) (76) 
i=i i=i 

where in (a), we have used the fact that the differential entropy of a t X 1 Gaussian vector with covariance 
matrix is | log ((27re)* det Q). 
Let t = 1 and = Zij. Therefore, 

^ Li 

HZij) < -^2 lo g( 27recr 5) ~~ a ^ log ai > 1 

1=0 1=0 

- a i>; log(2vre(xj ) + - a M log - a M loj 
i=o z=o 1=0 

Li ^ 

2 a ^ lo S ^ 



= log(v^7re<7 i)0 ) + - ^2 ai > 1 lo & "2" _ X] a ^ log a ^ ^ 77 ^ 

^ i=i ^.o z=o 

2 j-j-2 

However, for all / > 1, we have -tf- < - J £ L = 1 + c, r .7. Thus, 

h(^,i) < 2 a ^ log ^ + c *.^) + log(v / 27re<7 ii0 ) - a M log a M 
z=i z=o 

Li 

= a *'°) ^S^ 1 + Ci > L ^ + log(v / 27reo- ii0 ) - ^ a M log a^. (78) 

1=0 

This concludes the proof of Lemma 2. 



Appendix B; Proof of Proposition 1 

We have 4d = §£7 and 4h = I max ^ {^{iV (l - Let us define Q(v,N) = Noo^ 1 

where u v = 1 — -. Thinking of N as a real parameter for the moment, we have T^f2(t>, N) = 
uj*- 1 {N (\iiuj v ) 2 + 2\iiuj v ) . As N > 1, we have ^tt{v, N) > to^- 1 ((lnto v ) 2 + 2 lnu v ). But, (ln^) 2 + 
2 mc<;„ > if and only if u v < \ or oj v > 1. Since w v < 1, we get o;„ < \. This implies that the function 
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Q(v,N) is a convex function of N as far as uj v < \. Therefore, by Jensen's inequality, 



E { .V ( 1 - -) 



N-l 



E{Q(v, N)} > Q, (v, E{N}) = E{N} ( 1 - -J 



(79) 



which is valid as far as v > (l — ^) u. Hence, 
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- max 1 vE I N ( 1 - - 
2 « I IV u 



N-l 



1 r r / v^ n ~ i 

> - max <vE < N 1 - - 

2 06 [(i_^) tt)tt ] I I V u 



> -E{iV} max 
2 „ e [(i-£)«,«] 



w n E{iV}-l 



(80) 



E{iV}-l . 



The function v (l — -) v " / " is a concave function in terms of v that achieves its absolute maximum at 
-. Therefore, 



E{7V} ' 



V ^E{N}-1 

max < v ( 1 



1 1 W f I I 

max < 1 , — 77— - > 1 — max < 1 



E{iV}j 



e 2 ' E{iV} 



E{Af}-l 



Using (80) and (81), 



1 1 



1 — max < 1 — 



Vt?u > - max < 1 , • , -, 
/FH ~2 I e 2 'E{iV} 



Hence, a sufficient condition for 77^ > to hold is that 



1 1 



e 2 ' E{iV} 



E{iV}-l 



E{N}u. 



a. 

(81) 
(82) 



max < 1 



1 1 



e 2 ' E{N} 



1 — max < 1 



1 1 



e 2 ' E{N} 



E{JV}-1 



> 



(83) 



If E{iV} > we have max |l — j^, E ^ N y j = 1 — Hence, (83) reduces to the inequality E{iV} < 



|ln((e 2 - l)n max ). Therefore, if -j^- < E{iV} < \ In ((e 2 - l)n max ), then (83) is satisfied. On the 
other hand, if E{iV} < -^—^ = 1.1565, we get max jl — ^, Epvyj = e^v}- Thus, (83) reduces to the 



/ \E{JV}-1 

inequality ^4-^ (l — j^v} J > For each n max > 2, this yields an upper bound on E{iV}. 



Since 



E{N} 



E{N} 



E{N}-1 



is a decreasing function of E{iV}, the smallest of these upper bounds is 



obtained for n max = 2 and is equal to 1.2938. This means that for E{iV} < 1.1565, (83) is automatically 



satisfied. Thus, (83) is equivalent to 



E{N}< ^ln((e 2 -lK nax ). 



(84) 
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Appendix C; Proof of Proposition 2 

We have rjp^ = 2n u and 77^ = \ max„ jt>E | (l — '£) N 1 j j. The function (l — 1 is convex in 
terms of TV. Using Jenson's inequality, 

( 2 ) ^ „(2) 



2E{iV} V E{iV} 

Hence, a sufficient condition for 77^ > 77^ to hold is 



j \E{W}-1 x 

EW I' " EW ) > m 
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